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AMENDMENTS TO THE CLAIMS 

1. (Currently Amended) A method of constructing a test, comprising: 
selecting a test item for inclusion in a set of selected test items; 
updating at least one evaluation statistic based on the selected test item; and 
revising the set of selected test items to substantially correlate the at least one 

evaluation statistic with at least one psychometric specification for a test, wherein the at least one 
psychometric specification comprises one of an overall test difficulty r ating, a correlation 
between a correct response for a selected test item and a part icular cognitive or behavioral trait, 
an orientation of the presentation of questions and answers for the set of selected test items, a 
number of pa^es of text for a test, a mean point-biserial. a mean r-b iseriah and an arrangement of 
the set of selected test items , 

2. (Original) The method of claim 1 wherein the test item is selected at least in part 
based on a subject matter for the test item. 

3. (Original) The method of claim 1 wherein the at least one evaluation statistic is 
selected from a group including content specifications and psychometric specifications. 

4. (Cancelled). 



PTi #219923 vl (4PJZG1 UDOQ 

PAGE 4113 ' RCVD AT 7(2012005 2:29:32 PM [Eastern Daylight Time] * SVR:llSPTO-EFXRF-6/25 * DNIS:2738300 ' CSID: * DURATION (mm-ss):02*32 



JUL. 20. 2005 2:33PM 



NO. 349 P. 5 



5- (Currently Amended) The method of claim [4] 1. further comprising revising the 
set of selected test items to substantially correl ate the at least one evaluation statistic with at least 
one content specification for a test, wherein the at least one content specifications specification 
comprises one or more of the following: 

a number of test items to be presented in each of one or more pre-determined 

formats; 

a total number of test items to be included in the set of selected test items; 
a number of test items for testing each of one or more pre-determined subject 

matters; 

a key distribution; 

a percentage of test items having one or more pre-defined characteristics; 
a gender or racial orientation of test items; and 
a language in which the test items are presented 

6. (Cancelled). 

7. (Currently Amended) A method for constructing a test, comprising: 
selecting a portion of a test item database from which to select a set of test items 

for a test, wherein the test includes one or more test specifications; 

displaying information concerning a plurality of test items in the selected portion 
of the test item database; 

examining a test item on a display devic e, wherein the test item comp rises one or 
more of a percentage of correct responses f o r the test item, t-biserials, r-biserials, item resppn^ 
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theory parameters, gender-based response s tatistics, race-based response statistics, a percentage 
of responses choosing each distractor. and a f requency of previous usage for the test fem; 
selecting the test item for the test; and 

updating a value for at least one test specification based on specified properties 
for the selected test item. 

8. (Original) The method of claim ? wherein selecting a portion of a test item 
database comprises selecting a portion of a test item database based on a subject matter for test 
items contained within the portion of the test item database. 

9. (Currently Amended) The method of claim 7 wherein examining a test item 
further c omprises viewing one or more of the following: 

an image of the test item; 
statistical properties of the test item; 
text passages associated with the test item; 
an answer key; 

detailed content specifications; 

reviewers 1 comments; 

scoring guidelines; and 

artwork associated with the test item. 

10. (Cancelled). 

-4- 
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1 1 . (Original) The method of claim 7 wherein updating a value for at least one test 
specification includes using item response theory. 

12. (Original) The method of claim 7> further comprising: 

comparing current values for the one or more test specifications with required 
values for the one or more test specifications. 

13. (Original) The method of claim 7, further comprising: 

replacing one or more test items in the set of selected test items based on the one 
or more updated specifications. 

14. (Original) The method of claim 7, further comprising: 

adding one or more test items to the set of selected test items based on the one or 
more updated specifications. 

15. (Original) The method of claim 7, further comprising: 

removing one or more test items from the set of selected test items based on the 
one or more updated specifications. 

16. (Currently Amended) A system for constructing a test, comprising: 
a processor; 

a computer-readable medium operably connected to the processor; and 
a display, 
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wherein the computer-readable medium contains one or more databases each 
having a plurality of test items, wherein each test item comprises: 

a textual question and one or more answers for the test item, 

a content structure of the test item, aad 

one or more statistical properties for the test item; 

content specifications for a test; and 

psychometric specifications for the test, 
wherein the processor evaluates the content specifications and psychometric 
specifications while the test is being created wherein the processor determines a correlation 
value between the properties of the plurality of test items for the test and the content 
specifications and psychometric specifications for the test, and wherein the display displays the 
correlation value . 

17. (Original) The system of claim 16 wherein the statistical properties comprise one 
or more of the following: 

a percentage of correct responses for the test item; 

t-biserials; 

r-biserials; 

item response theory parameters; 

gender-based response statistics; 

race-based response statistics; 

a percentage of responses choosing each distractor; and 

a frequency of previous usage for the test item. 
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18-19. (Cancelled). 

20. (Original) The method of claim 16 wherein the computer-readable medium 
further contains instructions for performing a method of constructing a test comprising: 
selecting a test item for inclusion in a set of selected test items; 
updating at least one evaluation statistic based on the selected test item; and 
revising the set of selected test items to substantially correlate the at least one 
evaluation statistic with at least one specification for a test. 
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